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Abstract of JP 2003288334 (A) 
PROBLEM TO BE SOLVED: To generate a 
structured document such as an XML (extensible 
markup language) document and an HTML 
(hypertext markup language) document, by setting 
in appropriate places document logic elements other 
than sentence such as graphs . and tables, 
contained in a printing document consisting of a 
plurality of pages. ; SOLUTION: The device extracts 
a paragraph area and a graph area by analyzing 
document graphs in layout corresponding to a 
printing document with a layout analyzing part 1 1 
while segmenting characters in the paragraph area 
to recognize and process with a character 
recognizing part 12. It extracts a document logic 
element area from the paragraph area by providing 
a character recognizing result and a layout 
analyzing result to a document logic element 
extracting part 13, and carries out order setting 
respectively to a document logic element area and a 
graph/table area with a reading order setting part 14. 
Then, it extracts a document structure by grouping 
respectively the docu ment logic element area and 
the graph/table area with a document structure 
analyzing part 16, and generates the structure 
document by changing the appearance position of 
an area corresponding to the document logic 
elements other than sentence in the document 
structure and prov iding to a document output part 
17. ; COPYRIGHT: (C)2004,JPO 
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mmmcrMM] 

±3Bt»B** v a tv bmrntx^mmmb mmmm 
izmm-t hm^mm^mm-th w ry hw$&mt . 

w ry b mw&mzm-3\ -^x . isBazmm* 
^m^mv. msKtat. mm. m^mz. ^y?\ 

y-y-9. 0Mf7y 3 y, W^Koyxmwm 
±EI2*ffl«c0#ffi^tcM L T JiRif flit * fr o 

aBirawfc ±Mm$kffi&<n%®m:7)v-y-vctz> zbiz 

z coxwmmz^mz ± ^ xi&iztLtzxmmizm 

*n i Mm^9mmmm. 
[ n&s 3 ] ±sixmmmmmmm^mz x ~> x mm 
zKfz&mxmifommm^xm^xmimmmz^ 
mmmt Lxm^-r^^msm^^m^mtfzz t & 
mmt -thimm 1 tm^-xmmmm.* 

■*^ses*utif(c , %comi&<ommzif&t& m—m 
^m^-im&mm^mm-rt^ ry b%mm%t . 

zayVATy MBW#Sfc J: oTft&taWfcWBtfiOail 

fs« u a r v v tm^mzM^ ^x . ±.mxmmmfr 
tyxmMjftL. mmzitiu mm. w&mz. 
yy^. i«^7y 3 y, mm. xa&zvxmmm 



wmmM^mm-t^mmmmmmm^mb . 

>r <7M.mm.^mz x *> t tas $ *i^*h«wjb» t 

z nxwmmm&^mz ± -> t# & *tfc:sts«3&<?>*T 

[it m^6] ±3EX9ffims&z^mz. ±mmmmm 
izm-t& ?iv-y°* ^mmm^tti&ms^mizm 
mt& z t zmmb^mmL5imcD-xmw®MW. 
i mem 7 ] ±M&cmmm&e.^mi , ±ieiaaffiJi 
tmtt 7)v-y°**m<7>imxzwm- 1 z b wmb 

[ it s ] ±iBA««jt^s^i5J± . ±mmmmm 
izm-tz ?)v-y°z mmmzmwzmmix^&xm 
mmmmcommzWM~t& z t zmsLk-r&mtm 5 ie 

[ if Tim 9 ] jjEst** Jtsse^sji , ±t an««tt{ 

wmm^commzmsttt z t zqmb-tmims 

Mb l. %<vwM^iznmLt:xmwmfrt>i i mm£ 
<?mMaM*£atr h -xmm-fimxh ^ x . 
imzmmmivA rv vmm Lxjommbmmmm 
izm m-r h mrw& * mm t . 
z<r>vA rv vmmm^b Lxn^tifzxmmmcom^ 

mgmz. ^y?\ y-y?. wm*r j ry°i'B>. pa. 
mtt b-cojcmmmmmmzmm t , 
±.mxmmmmmmm t ±tBH*«««#iR«^*f t-r 

±K3t»i&fis*ffi« b ±mmmmMcD&wM% ?>v- 
y-it-tt z b t/zi. vxmmmzmm l. 
±mxmmmc?)*x-7'ju-y°ikZfxKm®h & v 

z ^mm^mmm^m^ ^x m%mft<nmmAK%m 
z^m-h z b £W{&b-t& xmmmjim a 

[0001] 
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m. ^y^-xm. ^-xm^k^mi-xm^mmnm. 
m w^m* km&i± i tz wm-%.w * m t «£ x m l ( ex te 

nsible markup language) i^HTML (hypertext 
markup language) I^&^lf^^*^^!.* 

[0002] 

3- Kftti i k lz J D , fflBBttKOF^lEfcVP 
S»T1± . **B»^R t * 5 t# g t 

[ o o o 3 ] ■■ "zsmmnmm 

mcofzubco^mK-xcD-m^m" . voi.3 

4, No.l, PP75-87, (1993-1) j fcr«£:fUf, S*tfmi: 

"mmm." tuxmemm (^v^rw) tzm-r& 
mmk Lx^k'&m^tLh „ zcnx? %im*±Mi,z 

[0004] ( 1 ) rs.Tsujimoto: " Major Component 
s of a Complete Text Reading System," Proceedings 
of THE IEEE, Vol.80, No. 7, July, 1992 j 

Z\cr>m$iTfc. vAr^vmmzx^xn^fitziyAT 

*?Y-*7i?3.9 Y<nmmmmmmzn\^x. u<oi> 
<n-wm£)v-)v*mm-h z 1 1= ± 9 . ttmsd; 
fjH-***fco^Tii^LTv^ft. zaftig 

[00 0 5] (2) r,HflU: ";t^— J; 
* 0^»flW^1iI^)flBSSSir , fi^ffrD-ii, Voi.J7 

5-D-II, No. 9, pp. 1514-1525, (1992-9) j 
Zttli, B#H*rBJ<0W h*7Vx ? r-£FIjSM 
^5 7t^S L „ )V—Mzm~3\ ^X Z <?)■? '=j 7 £ ffflR 
-fhZkXJA Y)V (UmL) , -ts^U-?, ^ 



xhh» 

[00 06] (3) r Oj-Ffffi : "^MzM-J^fzXW 
Bm<7)W TVhmM" , fl^D-II, Vol.J75-D-II, 
No. 10, pp. 1673-1681, (1992-10) j 

[00 07 ] (4) rf^Mfi: ''3c#H{fe«3t»tMWc 

s «*B^», Vol.34, No. 

1, PP75-87, (1993-1) j 

i*ui, uATVhffimkmmmmk^cottmm&zm 
-rxm^ff^m^xxiiJcsizMLxmi^mm^-h 
zk^zk^^Mm^m^-rh, -%m^?Mi. mmco 

co^m^im t> ^rrniz lt v \& . 

[0 0 08] (5) rajH: "S;#B«<7)ODA|feaffi 
®lTd»^<^E«**" . ft^D-II, Vol.J76-D-II, 
No. 11, pp. 2274-2284, (1993-11) j 
£ *Ui , A*Si»Sr O D A«fgfI?pPM ( /□ 4r y y-fft' 

^- h ) 26^»t >y e^-r*^5^c»* . fits 
yvfMmziK). xm?7xcr>mfei>m&kLx^ 

[0009] (6) r^5: "WSffitlV^jttt 

mm^mmm" , ft^D-n, v 0 i.j79-d-ii, no. 5, 

PP. 687-697, (1996-5) j 

SrJfflfith U X Mfjt^ttfii-r-i. <> <7>TX>h. 
[0010] 

[^Hff*i»^LJ;5i:-rSig|l] m^- 

wzm^-th l^co^mmmzMLx^^mmmmm 

xi (ffi^#S) ffiit) fcUiaS§*t*^jfflBlf«]R 

^mzm^ , EPisKWfciaift^ tt-c ^s^^xmls 

K 9 3^«5»Tfl»Ht-*-4 z k tfmttLZ . 

[ 0 0 1 1 ] *^HH<oaw{i. aas^— ^3&»^> 
mm z mw&m.mz&%. uxml ^t«^ html** 
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ass;****-* 

[0012] 

w brnmLxxmrnrntmrnmrn^ 
m-t^^-m^mm^uArvbrnm^mt. zv 
w t*7 bmm^mzx-yxm^titzxmm^m^m 

z ^x^mm^m^x^mmm^ t ±ta w 1- mm 
¥a?> w b mw&mzm-3\ -^x . isBazmm* 
^xm^mv. mim&i. a?§. ib&#^ ^-y^\ 
?-y*\ 0Mf7y 3 y, sua. m^fcoxmrnm 
mmmm^mm-t^^mmmmmmm^mt . z^xm 
mmwmmm^&. iz z ^ xn t> titzxmmmmmmm t 
±mmmmM^&wmiztt i twwh-s n o mmwk 
. ^mmwm.'M.^mzk^xm.^fitz^w. 
mmm t mmmm , nmm<omw.mi% izm^ ^x ±ia 
xm^mmmmm t ±nmmmmco^mm^ y>v- Tit 

t , z coxwm mt&m^mz ^x%t, Ktzxmmm.<r> 

wzmi^&xmmm&i^®.t . znxmmm&i^ 
at~=t -c^ms Ktzxmmmzm^\ ^tfjtSjfm^« 
mitxm^m-thmm^xm^^t zmmLxm 

[ooi3] zcox ozmmzzMi. xmmm^t 
ti&xmt wan^m®* 7>v-?°it Ltzxwm.^ 
x^tm^MM^Mim.^'w.x't h<vx\ mm 
mt^ tzxm t mmmmmzmtmtemzMife t 

TXM L^t^HTM LXm% t'CO 9 ^ftlt§*Utfflii 

\txm^^m-h z t a*-c# h . i ^3E-r^i= 
[0014] ±ie^«t&Jis«»ai#g^j; ot 

LTl£*^S^g5Pk*^a£fl;il>i 

ifiX'% h . 

[ o o i 5 ] _ht&;£««it3oe^a^ ±^tfi« 
t'^s ffis* £ m^pMzwm n&tzmiz^ * c^mmco 

[0016] 4fc, *^HBt4. ffi^-io^Sr&EWJ 



at , zcouAT^b mm^mz ± o -c# ^ wtsana 
r^b mm u-4T*?h mmmmzm^ \ ^x , ±t e 

^ximxmmmmmmm t ±mmmm®<?>&m® 
zy/b-y'it-t&ztizx ^xmmm^mm-nxvs 

ate i o-cssesnfc^wfBttcs^v^TBfSj^ow 

[0017] z(7)£ o&matzxtuf^ xmmmz-%% 
ti h xm t m^cozmm: yiv-nt t tzxmmcD* 

mnmzm-th&mmzi^ysi—y'kLx, ^cota 

iMLm^nLXXMLXm^UTMLXM^t'^f" 
[00 18] 

[0019] *aKH«jt«!Biffiarcii. *fwiE*. is 

feSflffl* (S*^^— ^TCCXMLif^HTM 
I,. HTMLI1 ys>fyN— "r^XbZm&t&tztbcOW 

h> XML|±, HTMLiOf^lSiST'ftD. SGML 
(standard generalized markup language) C0^~oi!i3§. 
WftfcWe b±T-tWfflnTS^ LfcSffiT**. HTM 
L t <7)jSv ^4, jl— 9* mkU<^>9 9'^-oX f'—9cr>m 
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[0020] i2 1 ( a ) i&s&nwsmt&k tzh otj 

(f^b) eoffefc, ll^fl&i: ftT 
^4. 4fc. 1310 (b) ii-€-«^t#B«t*f*ELfcflfit 

#^>H TMLJf^ f X'fo h . 
[002 1 ] H2l^«^-iei9^fc«43CW!!ffl 

-v-Hf ^£,3rSB«A7J^« 1 03&»^>aaW-«#8Rtfctf5 

Twrkm^U &*KOfiE»t:J:0 2«BiflMc3Bft§*i. 

Tt>SV\ ££>H<i, M^if^ffl¥5- 1 7 4 1 8 3-§- 

^T€E§^2ffiB^£A*B«£i^<r£^£. EP 
[00 2 2] H2 tzjfcT i a tc, #3aBKB£*5H-*:S: 

»yis!SBfi, n bwwsp 1 1 , j&smat 1 

2 , 1 3 , R*JRR£tf 14, it 

iwsafx-^^iRaJi 5, saMtJSjBwsB 1 6 . *s 
mjj&i ifrtiffifo^tih, ifwmt, mum. 

a» , iwynmicJi-jt »ffcWM»S fL4 3 > t 
a - ? tc^MS *Lfc c p u &7n y => a \zim% ftfc* 

TUfi-r h&m&mim&fi & cr>xh 

*. 

[0023] B^A^JKS 1 0 !6><!>A*S*Ut3C»B« 
fi*£§BcoW T^MHWSBl ltW^, ^<0A7l 

z<rm&<nw£hmt i ffi&wv4 vmwmt Lxm 

So 

[0024] a^wsti, H4 iz^rtx o [z^ommz 

eBffiS ( x 1 , y 1 ) t£TSra<7)fi[MffiI ( x 2 , y 

2 ) iz j: o t jtsrf - sctms, x/AT-^y mvrx- 
b iv^x t'^mmmmizm m-tzmttmu&tLxzi: 



[0025] z^x\ xmmmxu^ miiizartx -3 
tz. ■x^nmmmmni-f^tixmm^tL. tti. 

tt, JSfSTBt5^t?flf^S t r 1— S t r 
5 L . ZcO^CO^ft mm S t r 1 IZlt 5 ^>Cn>-% 

[00 26] S^fRWfcjmflRWfcS^llW 
^ffl¥9 - 1 6 7 2 3 3#&»0 rH«38Hl^ts it/ 

[00 27] ^ISIigP 12(1 {BRJf : 

Dmt" . «^W?g»fi^Ae«fl^, PR193-47, pp.3 
3-40, 1993. j IZJ: OSgfflS^TV^Ttjjav^ 

[0 0 28] <JJK, L^fT^bWWSPl lKJ:-9T#i9 

*tfc u >f r ^ h mvmw&j&wmsi t * tci»ttn 

SfRttmSP 1 3 tc-ifA ^#14 . *«!Plg5Rtttijatf 1 3 

[ o o 2 9 ] mi ( a ) i&taattafltfriBtt ( r 

, fs]H (b) (i^o^MS^^rhiimSti 
HI (a) K^-idK. 1SB« r ^*ffi 

«jj 3&»<5>»asswt r^vym&j iziz iwo. 1 

Vol. 1 j , 2S@« r^t*«Wj 3&>i5>«iajsnfc 

r ^*fitt4j frhm&zfifz r *itsmmtffi«j tew 
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xm, *<n3c¥wmim&G&mti& 1 2 t 

[0030]^, 5:#mas*ttffi^ffit lt{±. 
nmmw 11-250041 ^m<r> rjtiisi 

£\ #jtMWHI*<0««B4i«e®^«HS*L. 04 
7^0 6 tSp Lfc J: d £ , -5- <WS®l?^)rt»KS:*fT 

xmmmmmmm t jcmmm t j&WN&xm&tz * 

3»M£iiU mm. ^•yy, 7«y*. ^^7y 

a> mmmm) , samaju ass 

[00 3 1 ] SfBKfcowadU WifcT O i 

(OiXl, OiYl) , ^Tiffi(2:MJffiSSr ( O i X 
2, OiY2) fcU t h 3 it^t h 4 ^F^SWBifl 

( 1 ) £_kfflGMff ((OiXl-th3), (Oi 
Y 1 - t h 4 ) ) b^TSfoWMU ( O i X 1 , O i Y 

i ) T'&mzti&mmntmzim&mmmmm 
( 2 ) x^mmmmz r$u j tv^/t «t 

[0 0 3 2] -f-LTs -3 LTttffiLfc^+T*^ 

aytmmmt^mizim-t&xmmM*?. sjjsea 

II(OiX2, OiY2) tJ±tf*T*BCIMBS« ( o 

iX2 + th3, OiY2 + th4) TIFM^&flffi 

mcDTmzim^hmmmmmmz^tK&xmmMz 
mm&k Lxmm~?&. m^^y^ay^mm-t^tz^ 

[ o o 3 3 ] ijcfc, *»t#is«»mgp i 3 1 «t ->xm 
&zHtz-$mmmmmmfiv4 hwwsp 1 1 -ci# 

£>ft£ W lS*««t &&SE»JRl&£ffil 4 CA 

WWtlt*ftSrS*i4. i«0K»«SSKFffif: LTJ4, 9i 
itmaPF 1 1-25004 1 r^JtfaSISH 

4, -eofeU, W*«Er8 ( a ) 3 fc, 

[ 0 0 3 4 ] Z\<r>£ o iZ LX . «RR«J»a*«m 



A*I^S*r-^**^$aT**flKtjB^l 6{z 

t^M^j«£*-T0. hh (b ) ^^mmmmm 

[00 3 5 ] ^SffiitfilWSPl 6 M^if^-co* 
SflM5fcft-§-S*tfcK»«flHWi, 08 ( b ) fcSj* 

•iftas**»6«#i^- ^M^JtMissi* xm 

[0036] 3t«fit»tffgpi 6(4, 01 ofc^ri a 
^A«i^iis«i^*gP2 1 . xmwmmmy^- 

y"iYM>2 2 . ^atigf|ltmSI52 3 , ^#«jg^S§|52 

[0037] if, 2 l tc i 

t5„ 111 ^#«^«&fflS*<7)*T"^ -y 7 -y ^ 

ttmmmt Lxm^Ltimm^-t, 

[0038] tct3. ^7^»7^ISt^)-5T 

t), m ■ ^ ■ mumm%b'Ziztsi><vi$inz&b&bx 

mm.Xmco^ 99— 9 b LTfMT'* £jfctf>, Wiff 1 
^- >>' a <nizm\z ^'ffi^ 7 >y PMi&lZ'O V ->T 

«S UTfc < i 3 =5rffiR!£tc LT t ftv^ iT^-^tA. 
y -y ^ffl^^SLTfc < cOsWi^U-^** 

ffis c*bst § s t> « t -r § . 
[0039] f-^^-9^am<nx9mmm 
mz^mmmb Lxmi£Lx&< zbx\ taft&zti 
tz-xmmmmmzmiRmzmz-f &£o %nmx-h x 
t>&^. ^yy^y^y^^msmb lx^#> 
mrntxismi. ztL^m^Ltzmxtm^m^t 

[0040] %mmmm9'!v-7°i\LU2 2 x-a, 
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[0041] my/v—Tt^ju—mmLxit. *tl 

W.fcBBrr4 2ow3CMWB8l6««0 i , O j #H 

iz£t&bxM>ottift>tLX\->&zti> i ^t^o mum 

[0042]^7i/g 

■min (O i X2, OjX2) -max (OiXl, 
OjXl) > t h 1 , max < O i Y 1 , Oj Y 

1) -min (OiY2, O j Y2) <th2 

min (O i Y2 , OjY2)-max (OiYl, O 
j Yl ) >thl, A>0, max (OiXl, OjX 
1) -min (OiX2, OjX2) <th2 

oxi : ^Mmmmmmocr>^mmmco^±^xm. 

I. 0x2 : jdHWS8IKR«o<^HS®P<^feT*x 
mm, oyi : SSH»MIMH«owi«e©Btfafe±« 

y&il oy2 : jmrnsmmmmocotmimntiT 
my mm. t h i : mm. t h 2 : imrc* 0 , 

«<a£_Uf*KjS (0, 0) fc-fi. Wiffmi 

n (OiX2, OjX2) k (iXJ^gfflO i X 2 k O j 
X20r>dib<D'b-g\rJi&£ 0. max (OiXl, Oj 

xi) bitxmwmo i xi ko j xiwo^iu 
*t k 4 <r k . 

[0043] ^mm^mtam2 3-m. zmmmmr 

01 3^-tJ; ottfflklizt. ^Otm^ix 

4. 

[0044] l ^<rmM^Wf.<nMz\i, 0 l 3 

^-^f^ (ffl§Lh?)f^) tcJ^T. 0^>iS, BP 
i k £#jt:-t 4 k „ £*i6f5jfja9?*&* 



[0045] t;?. ^»«3S^MM24-C"{i. .r^J; 
3&^-**ji.oftajU S;«^jtttmSP2 3X%t=fi 

-rs. ;;t, 0^*^«fr*<M£5tkL-c. s 

iai4«0J:d^fllJi*OT3as. El 
14(a) {±^Smj^*«it. |W|0 ( b ) (i^Sf^* 
aBTCftO. H^*k^gP^*^'*»^"^-T^*S 
iz^W. £ ?«v^ ( H#tf>j5lttt# 
3B) . 

[0046] ifc, Hg|5^^gP^*^^M5tk L 

*j&j&*3oe£*is. 015 (a) i±3seffir«*flBt. R 
0(b) i±^mm^mm.Th k> . mm^tmm^ 

tfXM<D^miz^Zixtzt%&tf7sk%tiX\^& ( 0ffo 

[0047] H^tfttttcSSHLTV^Sawj 
SS?lfiSS«S*S* 4 MJift k # < #f!8 LTV ^ 4 JCmCO 

xmmsMmmm^mmimttx-miiiL, zcommn 

[0048] P&Srk'fcoV «> fflte&jL IZt tfX' 

[0049] tfz. m^m^t'^jv—yxit^K . ^ 
t7y 3 y (MS) ^k'^ff*>-rtc*3!fiT'aia-r4^ 

[00 50 ] «fc 3 1;, *W8JS(=t3^-c . mm** 

mm^b^z-h^ttfx^h. ^zx\ v&ssmttim 
corns (*st*«. iuBflrowrff ) **^L' 

ffij§<r)|Ii ? !iffiSSr0 14 ( b ) ^0 1 5 (b ) coioltZ 
^S^4i>c0kt-4„ 

[00 5 1 ] k <r^T\ 0^(±^7Ara^-i>T E a ; 5: 
o %m-& , 7C^r 1 o«JfiIII*ti5 o/ti «7)* s 

ffiics>4„ f;ts ^cmmmmmm^2 5xn. 3t« 
mmtzttfo&mmztyo* 

[00 52] 014 (c) ^0 15(c) t,Z2^coma. 

mm (tmnxwmmmm) &iofc:^L^jti** 
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